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ABSTRACT 

A primary motivation for our research in Digital Ecosystems 
is the desire to exploit the self-organising properties of 
biological ecosystems. Ecosystems are thought to be robust, 
scalable architectures that can automatically solve complex, 
dynamic problems. Self-organisation is perhaps one of the 
most desirable features in the systems that we engineer, and 
it is important for us to be able to measure self-organising 
behaviour. We investigate the self-organising aspects of 
Digital Ecosystems, created through the application of 
evolutionary computing to Multi- Agent Systems (MASs), 
aiming to determine a macroscopic variable to characterise 
the self-organisation of the evolving agent populations 
within. We study a measure for the self-organisation called 
Physical Complexity; based on statistical physics, automata 
theory, and information theory, providing a measure of 
information relative to the randomness in an organism's 
genome, by calculating the entropy in a population. We 
investigate an extension to include populations of variable 
length, and then built upon this to construct an efficiency 
measure to investigate clustering within evolving agent 
populations. Overall an insight has been achieved into 
where and how self-organisation occurs in our Digital 
Ecosystem, and how it can be quantified. 

Categories and Subject Descriptors 

C.2.4 [Distributed Systems]: Network Operating Sys- 
tems; D.2.11 [Software Architectures]: Patterns; H.1.0 
[Information Systems]: General 
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1. INTRODUCTION 

Digital Ecosystems are distributed adaptive open socio- 
technical systems, with properties of self-organisation, scal- 
ability and sustainability, inspired by natural ecosystems 
[9], and are emerging as a novel approach to the catalysis 



Philippe De Wilde 

Intelligent Systems Lab 
Department of Computer Science 
Heriot Watt University 
United Kingdom 
pdw@hw.ac.uk 

of sustainable regional development driven by Small and 
Medium sized Enterprises (SMEs). Digital Ecosystems aim 
to help local economic actors become active players in 
globalisation, valorising their local culture and vocations, 
and enabling them to interact and create value networks at 
the global level [16] . With its technical component being the 
digital counterpart of a biological ecosystem, providing for 
the evolution of software services (agents) in a distributed 
network [13, 12]. 

We considered the available literature on self-organisation, 
for its general properties, its application to MASs (the dom- 
inant technology in Digital Ecosystems) , and its application 
to the evolving agent populations of our Digital Ecosystem. 
Self-organisation has been around since the late 1940s 
[5], but has escaped general formalisation despite many 
attempts [24]. There have instead been many notions and 
definitions of self-organisation, useful within their different 
contexts [19]. They have come from cybernetics [5, 7], 
thermodynamics [24], mathematics [21], information theory 
[26], synergetics [18], and other domains [20]. The term 
self- organising is widely used, but there is no generally 
accepted meaning, as the abundance of definitions would 
suggest. Therefore, the philosophy of self-organisation is 
complicated, because organisation has different meanings 
to different people. So, we would argue that any definition 
of self-organisation is context dependent, in the same way 
that a choice of statistical measure is dependent on the data 
being analysed. Therefore, in the context of our Digital 
Ecosystems [11, 10] we shall further considering its self- 
organisation. 

2. SELF-ORGANISATION 

Proposing a definition for self-organisation faces the cy- 
bernetics problem of defining system, the cognitive problem 
of perspective, the philosophical problem of defining self, 
and the context dependent problem of defining organisation 
[17]. The system in this context is an evolving agent 
population, with the replication of individuals from one 
generation to the next, the recombination of the individuals, 
and a selection pressure providing a differential fitness 
between the individuals, which is behaviour common to any 
evolving population [8]. Perspective can be defined as the 
perception of the observer in perceiving the self-organisation 
of a system [7], matching the intuitive definition of / will 
know it when I see it, which despite making formalisation 
difficult shows that organisation is perspective dependent 
(i.e. relative to the context in which it occurs). In the 
context of an evolutionary system, the observer does not 
exist in the traditional sense, but is the selection pressure 
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Figure 1: Self- Organisation in Evolving Agent 
Populations: The agent population on the left in- 
tuitively shows organisation through the uniformity 
of the colours across the agent-sequences, whereas 
the population to the right shows little organisation. 

imposed by the environment, which selects individuals of 
the population over others based on their observable fitness. 
Therefore, consistent with the theoretical biology [8], in an 
evolutionary system the self-organisation of its population is 
from the perspective of its environment. Whether a system 
is se^-organising or being organised depends on whether the 
process causing the organisation is an internal component 
of the system under consideration. This intuitively makes 
sense, and therefore requires one to define the boundaries 
of the system being considered to determine if the force 
causing the organisation is internal or external to the 
system. For an evolving population the force leading to 
its organisation is the selection pressure acting upon it [8] , 
which is formed by the environment of the population's 
existence and competition between the individuals of the 
population [8]. As these are internal components of an 
evolving agent population [8], it is a self-organising system. 

Now that we have defined, for an evolving agent pop- 
ulation, the system for which its organisation is context 
dependent, the perspective to which it is relative, and 
the self by which it is caused, a definition for its self- 
organisation can be considered. The context, an evolving 
agent population in its environment, lacks a 2D or 3D 
metric space, so it is necessary to consider a visualisation 
in a more abstract form. We will let a single square, 
□ , represent an agent, with colours to represent different 
agents. Agent-sequences will therefore be represented by 
a sequence of coloured squares, I I I I . with a population 
consisting of multiple agent-sequences, as shown in Figure 
1. In Figure 1 the number of agents, in total and of each 
colour, is the same in both populations. However, the 
agent population on the left intuitively shows organisation 
through the uniformity of the colours across the agent- 
sequences, whereas the population to the right shows little 
or no organisation. 

While alternative definitions have been proposed [15, 6, 
25, 14], with each denning what property or properties 
demonstrate self-organisation, they lack applicability to 
evolving agent populations, because of the context depen- 
dent nature of self-organisation. However, the properties 
of Physical Complexity [4] closely matched our intuitive 
understanding, and so was chosen for further investigation. 

2.1 Physical Complexity 

Physical Complexity was born [1] from the need to 
determine the proportion of information in sequences of 
DNA, because it has long been established that the infor- 
mation contained is not directly proportional to the length, 
known as the C- value enigma/paradox [27]. However, 
because Physical Complexity analyses an ensemble of DNA 
sequences, the consistency between the different solutions 
shows the information, and the differences the redundancy 
[2]. Entropy, a measure of disorder, is used to determine the 



redundancy from the information in the ensemble. Physical 
Complexity therefore provides a context-relative definition 
for the self-organisation of a population without needing to 
define the context (environment) explicitly [3]. 

Physical Complexity was derived [3] from the notion 
of conditional complexity denned by Kolmogorov, which 
is different from traditional Kolmogorov complexity and 
states that the determination of complexity of a sequence 
is conditional on the environment in which the sequence is 
interpreted [23]. So, the complexity of a population S, of 
sequences s, 

£ 

C = (1) 

2=1 

is the maximal entropy of the population (equivalent to the 
length of the sequences) £, minus the sum, over the length 
£, of the per-site entropies H(i), 

H (i) = ~ Yl Pd ^ log \D\ Pd(i)i (2) 

where i is a site in the sequences ranging between one and 
the length of the sequences £, D is the alphabet of characters 
found in the sequences, and Pd(i) is the probability that site 
i (in the sequences) takes on character d from the alphabet 
D, with the sum of the Pd{i) probabilities for each site i 
equalling one, Pd(i) = 1 [3]. So, the equivalence of the 

d(ED 

maximum complexity to the length matches the intuitive 
understanding that if a population of sequences of length £ 
has no redundancy, then their complexity is their length £. 

If G represents the set of all possible genotypes con- 
structed from an alphabet D that are of length £, then the 
size (cardinality) of \G\ is equal to the size of the alphabet 
\D\ raised to the length £, 

\G\ = \D\ e . (3) 

For the complexity measure to be accurate, a sample size of 
\D\ £ is suggested to minimise the error [3], but such a large 
quantity can be computationally infeasible. The definition's 
creator, for practical applications, chooses a population size 
of \D\£, which is sufficient to show any trends present. 
So, for a population of sequences S we choose, with the 
definition's creator, a computationally feasible population 
size of \D\ times £, 

\S\ > \D\£. (4) 

The size of the alphabet, \D\, depends on the domain 
to which Physical Complexity is applied. For RNA the 
alphabet is the four nucleotides, D = {A, C, G, U}, and 
therefore | D\ = 4 [3]. 

2.2 Variable Length Sequences 

Physical Complexity is currently formulated for a pop- 
ulation of sequences of the same length [3], and so we 
will now investigate an extension to include populations of 
variable length sequences, which will include populations of 
variable length agent-sequences of our Digital Ecosystem. 
This will require changing and re-justifying the fundamental 
assumptions, specifically the conditions and limits upon 
which Physical Complexity operates. In (1) the Physical 
Complexity, C, is denned for a population of sequences of 
length £ [3]. The most important question is what does 
the length £ equal if the population of sequences is of 
variable length? The issue is what £ represents, which is the 



maximum possible complexity for the population [3] , which 
we will call the complexity potential Cp. The maximum 
complexity in (1) occurs when the per-site entropies sum to 

£ 

zero, ^2 H(i) — > 0, as there is no randomness in the sites 

i=l 

(all contain information), i.e. C — > £ [3]. So, the complexity 
potential equals the length, 

C P = £, (5) 

provided the population S is of sufficient size for accurate 
calculations, as found in (4), i.e. \S\ is equal or greater 
than \D\£. For a population of variable length sequences, 
Sv, the complexity potential, CV P , cannot be equivalent to 
the length £, because it does not exist. However, given the 
concept of minimum sample size from (4), there is a length 
for a population of variable length sequences, £y, between 
the minimum and maximum length, such that the number 
of per-site samples up to and including £y is sufficient for 
the per-site entropies to be calculated. So the complexity 
potential for a population of variable length sequences, Cv P , 
will be equivalent to its calculable length, 

C Vp =£v. (6) 

If £y where to be equal to the length of the longest indi- 
viduals) imax in a population of variable length sequences 
SV, then the operational problem is that for some of the 
later sites, between one and £ m ax, the sample size will be 
less than the population size \Sv\- So, having the length 
£v equalling the maximum length would be incorrect, as 
there would be an insufficient number of samples at the 
later sites, and therefore £v ^ £max- So, the length for a 
population of variable length sequences, £y, is the highest 
value within the range of the minimum (one) and maximum 
length, 1 < £v < 4ax, for which there are sufficient samples 
to calculate the entropy. A function which provides the 
sample size at a given site is required to specify the value 
of £v precisely, 

sampleSize(i : site) : int, (7) 

where the output varies between 1 and the population size 
| Sv\ (inclusive). Therefore, the length of a population of 
variable length sequences, £y, is the highest value within 
the range of one and the maximum length for which the 
sample size is greater than or equal to the alphabet size 
multiplied by the length £y, 

sampleS ize(£v) > |£>|^V A savnpleSize(£y + 1) < |.D|^y, 

( § ) 

where lv is the length for a population of variable length 
sequences, and £ m ax is the maximum length in a population 
of variable length sequences, £y varies between 1 < £y < 
£max, D is the alphabet and \D\ > 0. This definition 
intrinsically includes a minimum size for populations of 
variable length sequences, |D|^V, and therefore is the 
counterpart of (4), which is the minimum population size 
for populations of fixed length. 

The length £ used in the limits of (2) no longer exists, 
and therefore (2) must be updated; so, the per-site entropy 
calculation for variable length sequences will be denoted by 
Hv(i), and is, 

H v {i) = - ^2 Pd ^ log l^l P d W' ( 9 ) 

where D is still the alphabet, £v is the length for a 
population of variable length sequences, with the site i now 



C v = 4.420, %E = 88.4 C v = 0.575, %E = 11.5 
Figure 2: Abstract Visualisation for Populations 
of Variable Length Sequences: The Physical 
Complexity and Efficiency values are consistent 
with the intuitive understanding one would have for 
the self-organisation of the sample populations. 

ranging between 1 < i < £y, while the Pd{i) probabilities 
still range between < Pd(i) < 1, and still sum to one. 
It remains algebraically almost identical to (2), but the 
conditions and constraints of its use will change, specifically 
£ is replaced by £y . Naturally, Hy(i) ranges between zero 
and one, as did H(i) in (2). So, when the entropy is 
maximum the character found in the site i is uniformly 
random, and therefore holds no information. 

Therefore, the complexity for a population of variable 
length sequences, Cv, is the complexity potential of the 
population of variable length sequences minus the sum, over 
the length of the population of variable length sequences, of 
the per-site entropies (9), 

£v 

C v = £ v -Y^H v (i), (10) 

i=i 

where £v is the length for the population of variable length 
sequences, and Hv(i) is the entropy for a site i in the 
population of variable length sequences. 

Physical Complexity can now be applied to populations 
of variable length sequences, so we will consider the abstract 
example populations in Figure 2. We will let a single square, 
□, represent a site i in the sequences, with different colours 
to represent the different values. Therefore, a sequence of 
sites will be represented by a sequence of coloured squares, 
I I I I . Furthermore, the alphabet D is the set {□,□,□}, the 
maximum length £ m ax is 6 and the length for populations 
of variable length sequences £v is calculated as 5 from (8). 
The Physical Complexity values in Figure 2 are consistent 
with the intuitive understanding one would have for the self- 
organisation of the sample populations; the population with 
high Physical Complexity has a little randomness, while the 
population with low Physical Complexity is almost entirely 
random. 

3. EFFICIENCY 

Using our extended Physical Complexity we can construct 
a measure showing the use of the information space, called 
the Efficiency E, which is calculated by the Physical 
Complexity Cv over the complexity potential Cv P , 



The Efficiency E will range between zero and one, only 
reaching its maximum when the actual complexity Cv 
equals the complexity potential Cv P , indicating that there 
is no randomness in the population. In Figure 2 the 
populations of sequences are shown with their respective 
Efficiency values as percentages, and the values are as one 
would expect. 

The complexity Cv (10) is an absolute measure, whereas 
the Efficiency E (11) is a relative measure (based on 



the complexity CV). So, the Efficiency E can be used 
to compare the self-organised complexity of populations, 
independent of their size, their length, and whether their 
lengths are variable or not (as it is equally applicable 
to the fixed length populations of the original Physical 
Complexity) . 

4. SIMULATION AND RESULTS 

A simulated population of agent-sequences, [Ai, A±, A2, ...], 
was evolved to solve user requests, seeded with agents and 
agents from the agent-pool of the habitats in which they 
were instantiated. A dynamic population size was used 
to ensure exploration of the available combinatorial search 
space, which increased with the average size of the popu- 
lation's agents. The optimal combination of agents (agent) 
was evolved to the user request R, by an artificial selection 
pressure created by a fitness function generated from the 
user request R. An individual (agent) of the population 
consisted of a set of attributes, ai, <i2, and a user request 
consisted of a set of required attributes, ri,r2,—- So, 
the fitness function for evaluating an individual agent A, 
relative to a user request R, was 

fitness(A,R) = - 1 f , (12) 

1 + Ere* l r ~ °l 
where a is the member of A such that the difference to the 
required attribute r was minimised. Equation 12 was used 
to assign fitness values between 0.0 and 1.0 to each indi- 
vidual of the current generation of the population, directly 
affecting their ability to replicate into the next generation. 
The evolutionary computing process was encoded with a 
low mutation rate, a fixed selection pressure and a non- 
trapping fitness function (i.e. did not get trapped at local 
optima). The type of selection used fitness -proportional 
and non- elitist, fitness-proportional means that the fitter 
the individual the higher its probability of surviving to the 
next generation. Non- elitist means that the best individual 
from one generation was not guaranteed to survive to the 
next generation; it had a high probability of surviving 
into the next generation, but it was not guaranteed as it 
might have been mutated. Crossover (recombination) was 
then applied to a randomly chosen 10% of the surviving 
population, a one-point crossover, by aligning two parent 
individuals and picking a random point along their length, 
and at that point exchanging their tails to create two 
offspring. Mutations were then applied to a randomly 
chosen 10% of the surviving population; point mutations 
were randomly located, consisting of insertions (an agent 
was inserted into an agent-sequence), replacements (an 
agent was replaced in an agent-sequence), and deletions 
(an agent was deleted from an agent-sequence). The 
issue of bloat was controlled by augmenting the fitness 
function with a parsimony pressure which biased the search 
to shorter agent-sequences, evaluating larger than average 
agent-sequences with a reduced fitness, and thereby provid- 
ing a dynamic control limit which adapted to the average 
length of the ever-changing evolving agent populations. 

Figure 3 shows, for a typical evolving agent popula- 
tion, the Physical Complexity Cv (10) for variable length 
sequences and the maximum fitness Fmax over the gen- 
erations. It shows that the fitness and our extended 
Physical Complexity; both increase over the generations, 
synchronised with one another, until generation 160 when 
the maximum fitness tapers off more slowly than the 
Physical Complexity. At this point the optimal length for 
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Figure 3: Graph of Physical Complexity and 
Maximum Fitness over the Generations: The 
Physical Complexity for variable length sequences 
increases over the generations, showing short-term 
decreases as expected, such as at generation 138. 



the sequences is reached within the simulation, and so the 
advent of new fitter sequences (of the same of similar length) 
creates only minor fluctuations in the Physical Complexity, 
while having a more significant effect on the maximum 
fitness. The similarity of the graph in Figure 3 to the graphs 
in [4] confirms that the Physical Complexity measure has 
been successfully extended to variable length sequences. 

4.1 Efficiency 

Figure 4 is a visualisation of the simulation, showing 
two alternate populations that were run for a thousand 
generations, with the one on the left from Figure 3 run 
under normal conditions, while the one on the right was 
run with a non-discriminating selection pressure. Each 
multi-coloured line represents an agent-sequence, while each 
colour represents an agent (site). The visualisation shows 
that our Efficiency E accurately measures the self-organised 
complexity of the two populations. 



Population (normal conditions) Population (non-discriminating) 
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1 Agent-sequence (length) £v 1 

Figure 4: Visualisation of Evolving Agent popu- 
lations at the 1000th Generation: The population 
on the left from Figure 3 was run under normal 
conditions, while the one on the right was run with 
a non-discriminating selection pressure. 
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Figure 5: Graph of Population Efficiency over the 
Generations for the population from Figure 3: The 
Efficiency tends to a maximum of one, indicating 
that the population consists of one cluster. 



Figure 5 shows the Efficiency E (11), over the generations, 
for the population from Figure 3. The Efficiency tends to a 
maximum of one, indicating that the population consists of 
one cluster, which is confirmed by the visualisation of the 
population in Figure 4 (left). 

5. CONCLUSIONS 

We extended Physical Complexity to provide a greater 
understanding of MASs with evolutionary dynamics, specif- 
ically evolving agent populations, including our Digital 
Ecosystem. We then built upon this to define an Efficiency 
measure. Collectively, the experimental results confirm 
that Physical Complexity has been successfully extended 
to evolving agent populations. Most significantly, Physical 
Complexity has been reformulated algebraically for popula- 
tions of variable length sequences, which we have confirmed 
experimentally through simulations. 

Our Efficiency definition not only provides a macroscopic 
value to characterise the level of self-organisation, but 
the understanding and techniques we have developed have 
applicability beyond evolving agent populations; as wide as 
the original Physical Complexity, which has been applied 
from DNA [3] to simulations of self-replicating programmes 
[22]. 

6. ACKNOWLEDGMENTS 

The authors would like to thank the following for en- 
couragement and suggestions; Dr Paolo Dini of the Lon- 
don School of Economics and Political Science, and Dr 
Christoph Adami of the California Institute of Technol- 
ogy. This work was supported by the EU-funded Open 
Philosophies for Associative Autopoietic Digital Ecosystems 
(OPAALS) Network of Excellence (NoE), Contract No. 
FP6/IST-034824. 

7. REFERENCES 

[1] C. Adami. Introduction To Artificial Life. Springer, 
1998. 

[2] C. Adami. Sequence complexity in darwinian 

evolution. Complexity, 8:49-56, 2003. 
[3] C. Adami and N. Cerf. Physical complexity of 

symbolic sequences. Physica D, 137:62-69, 2000. 
[4] C. Adami, C. Ofria, and T. Collier. Evolution of 

biological complexity. Proceedings of the National 

Academy of Sciences, 97:4463-4468, 2000. 
[5] W. Ashby. Principles of the self-organizing dynamic 

system. Journal of General Psychology, 37:125-128, 

1947. 

[6] A. Barron, J. Rissanen, and B. Yu. The minimum 

description length principle in coding and modeling. 

IEEE Transactions on Information Theory, 

44:2743-2760, 1998. 
[7] S. Beer. Decision and Control: The Meaning of 

Operational Research and Management Cybernetics. 

Wiley, 1966. 

[8] M. Begon, J. Harper, and C. Townsend. Ecology: 

Individuals, Populations and Communities. Blackwell 

Publishing, 1996. 
[9] G. Briscoe. Digital Ecosystems. PhD thesis, Imperial 

College London, 2009. 
[10] G. Briscoe, M. Chli, and M. Vidal. Creating a Digital 

Ecosystem: Service-oriented architectures with 



distributed evolutionary computing (BOF-0759). In 
JavaOne Conference. Sun Microsystems, 2006. 

[11] G. Briscoe and P. De Wilde. Digital Ecosystems: 

Evolving service-oriented architectures. In Conference 
on Bio Inspired Models of Network, Information and 
Computing Systems. IEEE Press, 2006. 

[12] G. Briscoe and S. Sadedin. Digital Business 
Ecosystems: Natural science paradigms. In 
F. Nachira, A. Nicolai, P. Dini, M. Le Louarn, and 
L. Rivera Leon, editors, Digital Business Ecosystems, 
pages 48-55. European Commission, 2007. 

[13] G. Briscoe, S. Sadedin, and G. Paperin. Biology of 
applied digital ecosystems. In Digital Ecosystems and 
Technologies Conference, pages 458-463. IEEE, 2007. 

[14] G. Chaitin. Algorithmic information and evolution. In 
O. Solbrig and G. Nicolis, editors, Perspectives on 
Biological Complexity, pages 51-60. IUBS Press, 1988. 

[15] J. Crutchfield and O. Gornerup. Objects that make 
objects: the population dynamics of structural 
complexity. Journal of The Royal Society Interface, 
3(7):345-349, 2006. 

[16] P. Dini, G. Lombardo, R. Mansell, A. Razavi, 
S. Moschoyiannis, P. Krause, A. Nicolai, and 
L. Rivera Leon. Beyond interoperability to digital 
ecosystems: regional innovation and socio-economic 
development led by SMEs. International Journal of 
Technological Learning, Innovation and Development, 
1:410-426,2008. 

[17] C. Gershenson and F. Heylighen. When can we call a 
system self-organizing? In J. Carbonell and 
J. Siekmann, editors, European Conference on 
Advances in Artificial Life, pages 606-614, 2003. 

[18] H. Haken. Synergetics: an introduction: 

nonequilibrium phase transitions and self- organization 
in physics, chemistry, and biology. Springer, 1977. 

[19] F. Heylighen. The science of self-organization and 

adaptivity. The Encyclopedia of Life Support Systems, 
pages 253-280, 2002. 

[20] J. Lehn. Perspectives in supramolecular 

chemistry — from molecular recognition towards 
molecular information processing and 
self-organization. Angewandte Chemie International 
Edition in English, 29:1304-1319, 1990. 

[21] G. Lendaris. On the definition of self-organizing 

systems. In W. Banzhaf, editor, European Conference 
on Advances in Artificial Life, pages 324-325, 1964. 

[22] E. Lenski, C. Ofria, R. Pennock, and C. Adami. The 
evolutionary origin of complex features. Nature, 
423:139-144, 2003. 

[23] M. Li and P. Vitanyi. An Introduction to Kolmogorov 
Complexity and Its Applications. Springer, 1997. 

[24] G. Nicolis and I. Prigogine. Self- organization in 

Nonequilibrium Systems: From Dissipative Structures 
to Order Through Fluctuations. Wiley, 1977. 

[25] A. Priigel-Bennett. Modelling evolving populations. 
Journal of Theoretical Biology, 185:81-95, 1997. 

[26] C. Shalizi. Causal Architecture, Complexity and 
Self- Organization in Time Series and Cellular 
Automata. PhD thesis, University of 
Wisconsin-Madison, 2001. 

[27] C. Thomas Jr. The genetic organization of 

chromosomes. Annual Reviews in Genetics, 5:237-256, 
1971. 



